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ABSI'P.ACT 

This paper discusses several evaluative aethods that 
are available for use in a reading prograa that is aiaed at English 
as a Second Language (BSL) students* The contents include: 

Evaluation,** vhich discusses the role of evaluation in reading; 
«Teachej^ Observation,** vhich looks at hov the teacher can evaluate 
the reading progress of students through observation; "Standardized 
Tests,** vhich discusses the use of standardized tests, the validity 
of standardized tests, and the inappropriateness of standardized 
tests for ESL students; **Inforaal Reading Inventories,** vhich 
riscusses the difference between group inforaal Reading inventories 
CTRI) and individual IRIs the reading levels identified by an IRI, an 
IRI recording key, and the criteria for establishing reading levels; 
and *• Variables of Perforaance," vhich discusses additional variables, 
such as XQ, socioeconoaic background, and conditions under which the 
student was evaluated. CBR| 
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EVALUATION 

Evaluation should be an integral part of a reading program. Measur- 
ing student performance is ncicessary in order to provide the teacher with 
tho information concerning the student ♦s reading level, if he is really 
learning ard if the method of instruction used by the teacher is effec- 
tive. In residing instruction, various sets of sub-skills are presented 
in seguontial order which combine to create an effective reader. It is 
important to measure student performances on each sub-skill before the 
next one is introduced. If specific skill attainment is not measured, 
the effectiveness of instruction will bo lessened. 

The teacher has to know the general reading level of a student as 
well as his particular weaknesses. Evaluative tools provide the infor- 
mation necessary for placement and diagnosis. Placement tests give a 
grade score which establishes the general reading level of tho student. 
Such tests are usually standardized with normr. stated from a sample pop- 
ulation. Diagnostic instruments attempt to point out specific reading 
problems, with tho knowledge gained from these placement and diagnostic 
procedures, tho teacher is able to proscribe appropriate instruction. 

Evaluation should be a continuous process which can involve various 
procedures. These include teacher observation, standardized tests, and 
informal reading inventories. 



TEACHER OBSERVATION 

Teacher observation is extremely important for evaluating students* 
reading progress. These observations, recorded over a period time in the 
form of anedoctal records, can result in many valid findings, Moreover, . 
the teacher should observe his students v/ith certain objectives in mind. 
The objectives may be related to phonological, syntactic or semantic dif- 
ficulties shown by tho students. 

Since observations are subjective and teacher ratings tend to bo 
higher than the students' performa.icos on objective •* tests", they should 
not be the only tool used for measurement. Another evaluative instrument 
which does not rely so heavily on the reading training and teaching ex- 
perience of the instructor for valid results should accomnany teacher 
observations. 



STANDARDIZED TESTS 
An impersonal and mechanically devised instrument such as a stan- 



i:nrai7.oc; test cannot be a true hioanarc of a Gtudont's roadinq norfor- 
m^nco, slncci the reading procosB is not mechanical. The validity of 
ntandardized tests to aid in placement and diagnosis of reading sub- 
skilln is hlqhly questionable. Thoy should only bo used when a conimr- 
ison in to bo made between one students* performance and t:ic perfor- 
mance of a given qroup or as initial testing to give direction to the 
noxt step in evaluation. It is especially important to realize the lim- 
itations of standardized tests v/hen evaluating HSL students. Tlicso 
tosts can be disconcerting because of trie lexical items, syntactical 
complexity and/or a feeling of anomio in the testing situation. If the 
sfiKlnnt meets such frustration, it is possible that he nay never reap- 
pear for instruction. 

In addition, most standardized tests deal with subject matter 
faniliAr to the majority of native born readers but not to most foreign 
born readers. Fov; culture froc tests are available. It is, therefore, 
i •sponsible to evaluate an IXL r : acirr properly by using standardized 
tests. 



INFORf.lAL i".,/vDIUG inVCUTORV 

The Informal Heading Inventory (ini) is called informal because 
tJiorc are no standardized norms. Vhe evaluation is given in absolute 
terms, that is, t'le student is rated against perfection at a given l^v- 
cl and not against other students* performances. The purnoso of the ini 
is to evaluate the stndonts*s reading p^'ocess, which includes both the 
language and thinking functions. It evaluates the student's decoding 
skills as as his manipulation of the ideas as roprononted by the 

uords. 

The test dof?igned for KSL students should consist of tv;o sections; 
one in his native language and the other in r.nglish in ordeir to dpt^^^r- 
mine his lovol of literacy in both Icinguiges. The English sectioii oC 
the Il^I .'ihCiUld bo based on the carrj.culum to be presented. 

There are two typos of iril: group and individual. 
GROUP n HAD IMG INVENTORY 

The group IllI is comprised of graded r.aragrnphs wit}iin t!ie rnnqe 
of projected reading levels. Tollowing each paragraph there are somnre- 
li'^nsion questions including r'~^call and infcrcnco typos. Th'^ selection.; 
arrc based on the specific curriculum to be ir.nlrr.entod. 

The group IRI is designed so as to tost more than one student at 
a tine. Students are ashed to read the selections silently and answer 
the questions with no specific time limit. 

&ascd on the number of questions he is able to ansvrer correctly, 
three basic reading levels can be established. They are the inriepGn-- 
dent, instructional, and f rustrational levels. 



Indcpondont Luvol - The independent level is tho level at v;liich 
the student can function virtually on his own. To function at thif? lev 
el the student must b^? free of tensions while reading. Ho should bo 
able to respond to recall, inference and other comprehension questions 
with D0% accuracy. 

Instructional Level - Tho instructional lov*'il is that point at 
which the student should bo taught. T^tilo roarlinq the selection oral- 
ly the student *j; voice tone nhould ho relaxed and tho reading should 
be relatively rhythmif^. 

Since this ic tho level at v;hicli ntudrnts would '^e able to nrofit 
fron instruction, the studfr?nt r»hoalu oncrounler nc m- ' di fflc^ilty than 
f?ffoctivo instruction can ovorcomo. Specific criter:*.! for the instruc- 
tional level is 75C, efficiency in coinprehcnr,ion. 

Frustrati o n Level - \;hon a r.tudent is totally unable to deal with 
naterialn,he hSis reached his frustration level. FailuiO to nr^ot the 
criteria for instructional and independent lcvoir> would indicate frus- 
tration. Specifically, if tho student couprehemin only 50'^,, he in read 
ing at a frur.tration level. 

The qroup inventory is not the moat effect. ivo form of evaluation, 
fiinco it is aimed at the averaqo readina level. Those ntmlontn v/ith 
greater 1:nowle<lqe will monopollar the in;;truction while those who fioor- 
od in the lov;or half v/lll be lost. 



INDIVIDUAL nnADXMG IIIVilNTORy 

The individual IllI is composed of graded paragraphs fol lowed i>-; 
comprehension questions . Precedina each paragraph is a list of ten 
key words which arc included in the selections. 

The student is asked to road the first list of words. If he c/tn 
easily read H0% or 0 out of in of the words, he in asked to rcad'tJ^e 
corresponding paragraph. If he is unaf»lo to road 00% of tho first list 
the reading level of this test is too difficult, and a simpler form 
should be administered. The student who attains 90% or more is asked 
to road the list at tho next level of difficulty. Ho progros'-.es in tho 
same manner until ho reaches the level where he can make only 89?> of 
tho words. At that point, he is asked to read the corresponding nara- 
qrar^h. Ordinarily the student reads the list of words aloud to the 
o.raKiiner. liowcvcr, tho ESL student should be given tlie opportunity to 
read it silently first. 

In addition to tho copy from which tho student roads, the teacher 
keeps a cony for each student tested. As tho student reads the para- 
graohy, the examiner records reversals, subntitution.s, mispronuncia- 



tions, ommisstons, and othor reading errors. Tho tcstor may dovico 
any ayiJtora for such racording. A suggested one is given below: 



Informal Reading Inventory Rooordinq Key 

^ Use this mark to show any additions of words, syllables, or 

endings. Write tho exact addition above it. 

boj^ Circle any v/ords, parts of words, or punctuation marks omit- 
ted. 

Mh 

J9«4k If a student substitutes a letter or a word, cross out tho 

element in tho passage and write the student's substitution 
^ above it. 

iie^s Write an n above any words repeated. If groups of word.n are 
repeated, drav/ an arch above them showing which v;ords v;ere 
repeated. 



Cross out and write (using phonetic spelling) the student's 
pronunciation above any words mispronounced. 

Place a check before a word where the student hesitated. 
(Administrator counts 1-2) 

Write P above all v;ords pronounced for the student. (Oivu 
tho v;ord if the student hesitates as long as the count 1- 
-2-3-4-5- or if ho mispronounces a word so badly that it 
will interfere \^ith his comprehension. 



ILLUSTtlATIO:? 
. Level Three 

Mrs. JThuiii decided to get Tom's clothes ready to mail 
Tom wanted, his wooi socl® and warfnclothcs. Mrs. yii r ii 't v 
found a big brown box in tho^ttic. She also wanted to pack 
Tom's blue bedspread and her sunglasses. Mrs. Thi ' ii ' ii nackeci 
everything, Peciuse thoro was still room in^hc box she 
decided to bake some nut bread for Tom, 
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Aftor the student reada thft pnraciranh, the teacher asks the comnro- 
hnnnion questions and rncordn hin answers. 

Basod on tho pcrcontaqo of v/ords rccdanizod and comprohcnsion quos- 
tiona correctly answered, tho student's basic independent instructional 
and frustration levels can bo er.tahllshed. The specific criteria for 
nncAi level are: 



IMOnPnriDr.riT 99% Uord locro'^nltion 

90 ?. Connr'^'Uonr. ion 



iriSTRUCTmiAL 95-:i Uord nocoanition 

73:% Comnrchcnr,ion 



rnUKTIUVTIOMAL 90?, Uord ^ocognition 

Anything Irns than 7f>^ comprohonsion 

Since these lovolr. aro indicat ive of tlu^ porfoimanoo of a studont 
on one set of select ionjj, it is important t!iat Vao }>araqraphs aro o::om~ 
plary of tho materials to be usocl or-^c the ovalu.-it i ^"-^ )rocoduro is oom- 
pl'^tod. The tost mur;t bo dcsianod Ijinc-, a;»on th' c.tivcir> of tho pro^ 

gr<im in ordor to ma'.ic the dinnoni.i rclov^nt to ^lio .roatment. 



VARiAi'Liir. OP ?r.:iFOii:iA:jcn 

There are variables of performance that mur^t be considered in tho 
evaluative process using any of tho aforeuicntioned methods. The stu- 
dent'n motivation, socio-economto background, and psyeholinguistic 
cxnerionco must bo taken into account. 

Another Intportant aspect is that tho nerfornnnco nust bo judged as 
a performnco only undor one not of conditions, T}io time of day, content 
of the material and tlio ojMmincr aro all vari bibles which am not taken 
into acv^ouut in t'.o scoring procedure. 

Tho most imnortant varial>lo to he conside^r6»d v/ith KSL adult is the 
socio-ocononic factor and its relationship to the content of the ^oot. 
There is a definite correlation between the student's performance on 
standardized tests and his socio-economic background. The student's 
s'^oro decreases as his socio-economic background decreases. 

A variable common to all performance is 19. Tho adult I.Q. tost. 
(WAIC) can bo used as a orediction of reading nrogram if the examiner 
considers the variables previously discunod. It is suggested tliat such 
tests bo administered only v;hcn aJ^solutoly necosaary and if problems arc 
througli observation and other oualaativo tools. fUncc tiie WAXS is a stan- 
dardized tost the name liiiti tat, ions previously mentioned for otlior stan- 
di^rdizod tests also hold true for th^-s test. 



BEST COPY AVMlABt*^ 



Knaluntion r.t a nrncannrif and inpnrtant aopoat of the poadinn pro" 
nvnf^, Sfpopftl nvaluatixuj mothods nrc aDailahlc for uaa, Thonc include 
informal ini>ontorn , teacher ohartrvati'on^ d ntandardinad tt?/?f.n. The 
rrctf}t nppropriatn of thano nltr,rnrrttvcn . f uncd vith KSL r^tudnnto ic 
thfl individxtal informal raadinQ tnvcntoru » 
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